RNN Based Sampling Technique for Effective Active Learning
نویسندگان
چکیده
In this paper, we address the problem of active learning using the notion of influence sets based on Reverse Nearest Neighbor. Active learning is an area of machine learning which emphasizes on achieving optimal classification performance using as few labeled samples as possible. Reverse nearest neighbors have been used in domains such as clustering and outliers detection in the past effectively. In this paper, we devise a new sampling method for instances based on the knowledge provided from RNN influence sets. To demonstrate the effectiveness of our sampling method, we compare its performance against existing sampling methods on few real life datasets. The experimental results show that our technique outperforms existing methods, particularly on multi-class datasets.
منابع مشابه
Accelerate RNN-based Training with Importance Sampling
Importance sampling (IS) as an elegant and efficient variance reduction (VR) technique for the acceleration of stochastic optimization problems has attracted many researches recently. Unlike commonly adopted stochastic uniform sampling in stochastic optimizations, IS-integrated algorithms sample training data at each iteration with respect to a weighted sampling probability distribution P , whi...
متن کاملPaired Sampling in Density-Sensitive Active Learning
Active learning consists of principled on-line sampling over unlabeled data to optimize supervised learning rates as a function of the number of labels requested from an external oracle. A new sampling technique for active learning is developed based on two key principles: 1) Balanced sampling on both sides of the decision boundary is more effective than sampling one side disproportionately, an...
متن کاملSemi-Supervised Training in Deep Learning Acoustic Model
We studied the semi-supervised training in a fully connected deep neural network (DNN), unfolded recurrent neural network (RNN), and long short-term memory recurrent neural network (LSTM-RNN) with respect to the transcription quality, the importance data sampling, and the training data amount. We found that DNN, unfolded RNN, and LSTM-RNN are increasingly more sensitive to labeling errors. For ...
متن کاملExploration of Arak Medical Students’ Experiences on Effective Factors in Active Learning: A Qualitative Research
Introduction:: Medical students should use active learning to improve their daily duties and medical services. The goal of this study is exploring medical students’ experiences on effective factors in active learning. Methods: This qualitative study was conducted through content Analysis method in Arak University of Medical Sciences. Data were collected via interviews. The study started with p...
متن کاملActive Learning: An Approach for Reducing Theory-Practice Gap in Clinical Education
Introduction: The gap between theory and practice in clinical fields, including nursing, is one of the main problems that many solutions have been suggested to eliminate it. In this article, we have tried to investigate its solution through active learning. Methods: In this review article, searching articles published during 2000-2012 was done through library references, scientific databases. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011